Model-based reinforcement learning for router port queue configurations
نویسندگان
چکیده
Fifth-generation (5G) systems have brought about new challenges toward ensuring Quality of Service (QoS) in differentiated services. This includes low latency applications, scalable machine-to-machine communication, and enhanced mobile broadband connectivity. In order to satisfy these requirements, the concept network slicing has been introduced generate slices with specific characteristics. meet requirements slices, routers switches must be effectively configured provide priority queue provisioning, resource contention management adaptation. Configuring from vendors, such as Ericsson, Cisco, Juniper, traditionally an expert-driven process static rules for individual flows, which are prone sub optimal configurations varying traffic conditions. this paper, we model internal ingress egress queues within via a queuing model. The effects changing configuration respect priority, weights, flow limits, packet drops studied detail. is used train model-based Reinforcement Learning (RL) algorithm policies prioritization, fairness, congestion control. efficacy RL policy output demonstrated over scenarios involving policing, shaping, one-hop router coordinated conditioning. evaluated real application use case, wherein statically proved desired QoS requirements. Such automated will critical multiple 5G deployments patterns.
منابع مشابه
Model Checking Programmable Router Configurations
Programmable networks offer the ability to customize router behaviour at run time, thus increasing flexibility of network administration. Programmable network routers are configured using domain-specific languages. The ability to evolve router programs dynamically creates potential for misconfigurations. By exploiting domain-specific abstractions, we are able to translate router configurations ...
متن کاملModel Checking Programmable Router Configurations with Spin
In this paper we describe the use of model checking techniques in the application area of programmable networks. Programmable networks offer the ability to customize router behaviour at run time, thus increasing flexibility of network administration. Programmable network routers are configured using domain-specific languages. The ability to evolve router programs dynamically creates potential f...
متن کاملReinforcement Learning: Model-based
Reinforcement learning (RL) refers to a wide range of dierent learning algorithms for improving a behavioral policy on the basis of numerical reward signals that serve as feedback. In its basic form, reinforcement learning bears striking resemblance to ‘operant conditioning’ in psychology and animal learning: actions that are rewarded tend to occur more frequently; actions that are punished ar...
متن کاملModel-Based Reinforcement Learning
Reinforcement Learning (RL) refers to learning to behave optimally in a stochastic environment by taking actions and receiving rewards [1]. The environment is assumed Markovian in that there is a fixed probability of the next state given the current state and the agent’s action. The agent also receives an immediate reward based on the current state and the action. Models of the next-state distr...
متن کاملAdaptive Abstraction for Model-Based Reinforcement Learning
This paper presents a novel model-based reinforcement learning framework called the Adaptive Modelling and Planning System (AMPS). The challenge of a model-based reinforcement learning agent is using experience in the world to generate a model. In problems with large state and action spaces, the agent must generalise from limited experience by grouping together similar states and actions, effec...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Intelligent and converged networks
سال: 2021
ISSN: ['2708-6240']
DOI: https://doi.org/10.23919/icn.2021.0016